NORMAL AUTOMORPHISMS OF A FREE 
METABELIAN NILPOTENT GROUP 

GERARD ENDIMIONI 

Abstract. An automorphism <p of a group G is said to be normal 
if ip(H) = H for each normal subgroup H of G. These automor- 
phisms form a group containing the group of inner automorphisms. 
When G is a nonabelian free (or free soluble) group, it is known 
that these groups of automorphisms coincide, but this is not al- 
ways true when G is a free metabelian nilpotent group. The aim 
of this paper is to determine the group of normal automorphisms 
in this last case. 



1. Preliminary results 
In a group G, consider a map tp : G — > G of the form 

ip : x — > x [x, Ui\ y ' . . . [x, u m \ y ' , 

where . . . . Urn c^rG elements of G, the exponents A(l), . . . , A(m) being 
integers (as usual, the commutator [a, b] is defined by [a, b] = a~ 1 b~ 1 ab). 
When G is metabelian, using the relation [xy, u] = u]y[y, u], it is 

easy to see that ip is an endomorphism of group. These endomorphisms 
appear in [Tj as a solution to a problem of extension from G' to G for 
certain endomorphisms (also see [1]). 

Now consider in an arbitrary group G the map (p U:V : x — > x[x, u][x, v], 
with u,v G G and suppose that (p UiV is an endomorphism. It is then 
easy to show that the equality <p u>v (xy~ x ) = tp u ,v{.%)<{ ) u,v{.y~ 1 ) is equiva- 
lent to the relation [u, y][x, v] = [x, v] [u, y] . Consequently, if ip U)V is an 
endomorphism for any u,v G G, the group G is metabelian. One can 
summarize these preliminary remarks like this. 



Proposition 1.1. In a group G, the following conditions are equiva- 
lent: 
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(i) every map (f : G — > G of the form <p : x — > x J^J [rr, G 



8=1 



G, X(i) G Z) an endomorphism; 
(ii) G zs metabelian. 

It is very easy to see that in an metabelian group, such endomor- 
phisms are not necessarily automorphisms (consider for example the 
endomorphism x — > x[x, in the nonabelian group of order 6 defined 
by the presentation (a, b \ a 3 = b 2 = (ab) 2 = 1)). But in a nilpotent 
group, each map of the form 

x -> w x x ^ Wl x x{2) . . . x x{n) w n (with A(l) + A(2) + • ■ • + A(n) = ±1) 
is bijective [21 Theorem 1]. Hence we have: 

Proposition 1.2. In a metabelian nilpotent group G, every map if : 

m 

G — > G of the form <p : x — > [a?, Wi] A< ^ (w« G G, X(i) G Z) an 

i=i 

automorphism. 

For convenience sake, in a metabelian nilpotent group, an automor- 

m 

phism of the form x — > x Y\ [x, Ui] X ^ will be called a generalized inner 



8=1 



automorphism. Obviously, every inner automorphism is a generalized 
inner automorphism, since u~ x xu = x[x,u]. Notice that in a nilpotent 
group G of class < 2, we may write 



m m 

Mi) 



if(x) = x Y\ [x, u t ] x{%) = x JJ [a 



x 



8=1 8=1 



'II u X ^ 



n 

8=1 



Hence <^(x) = x[x,m] = u x xu, where u = Y\u X . Consequently, in 



8=1 



a nilpotent group of class < 2, the notions of inner automorphism and 
generalized inner automorphism coincide. On the other hand, in the 
free nilpotent group of class 3 and rank 2 freely generated by a and 
b, it is easy to see that the map x — > x[x,a,a] is a generalized inner 
automorphism but is not an inner automorphism. 

As usual, in a group, the left-normed commutator [xi, . . . , x n ] is de- 
fined inductively by 

[xi, • • • , Xri\ [^l) • • • j Xn— i] [^l? ■ • • j X n — i] 

[xi, • • • , X n [xi, • • • , Xn—ijXjj. 
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The next technical result will be useful in the following. 

Proposition 1.3. In a group G, consider a map if : G — > G of the 

form 

n 

ip(x) = x • • • , fi, CT (i)] r ' (i) (77 (i) G Z), 

i=i 

/or some function a : {1, . ..,n} — ► N \ {0} and elements G G 
(l<i<n, l<j< a{i) ). Then ip(x) can be written in the form 

(p(x) = x [x, Wi] . . . [x, « m ] A ' m ' G Z, Ui E G). 

Proof. By induction, using the relation [x, y, z] = [x, w] _1 [x, z] _1 [x, yz] 

□ 

Frequently in this paper we shall make use of well-known commuta- 
tor identities (see for example [10, 5.1.5]). In particular, we have the 
following relations, valid in a metabelian group G, for any x,y, z G G, 
t G G' and A G Z: 

[xt,y\ = [x,y\[t,y\ [t\ y] = [t, y] x 

[x, y, A [y, z, x] [z, x,y] = l [t, x, y] = [t, y, x) 

Proposition 1.4. The set of generalized inner automorphisms of a 
metabelian nilpotent group G forms a (normal) subgroup of the group 
of automorphisms ofG. 

Proof. If <p and ip are generalized inner automorphisms respectively 
defined by 

m n 

=xl[{x,u i ] xit) , 4>{x) =xY[[x,v i ] ft ®, 

1=1 1=1 

an easy calculus shows that 

m n m n 

1=1 1=1 1=1 j=i 

Thus ij} o ip is a generalized inner automorphism by Proposition 1.3. 
It remains to prove that (p^ 1 is a generalized inner automorphism. For 
that, it suffices to construct for each integer k > 1 a generalized inner 
automorphism ipk such that ipk V 9 is °f the form 

m 

ip k o ip : sc -> x JJ[a;, t^i, . . . , tV(i)F W 
i=i 
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for some function a : {1, . . . , m} — ► N \ {0} and elements Vij G G 
(1 < % < m, 1 < j < cr(i)), and where each commutator is of weight > 
l+2 fc_1 (namely, a(i) > 2 /c ~ 1 for % = 1, . . . , to). Indeed, since G is nilpo- 
tent, this implies that ipk°^{x) = x for k large enough, thus f' 1 = ipk is 
a generalized inner automorphism, as required. We argue by induction 
on k. The result is clear when k = 1 by taking for ipi the identity map. 
Now suppose that for some integer k > 1, there exists a generalized 

inner automorphism ipk such that ipk°^p{x) = x \\[x-, v^i, • • • , Wi jCT (i)]' 7 ^, 

i=i 

with cr(i) > 2 fe_1 for i = 1, . . . , to. Put ipk+i = ip' o ipk, where ip' is 

m 

defined by ip'(x) = x TT[ We have 



V>fc+1 o (p(x) = xY\[x,Vij 



l»?(0 



Since 



i=i 

m 

n 



i=i 



i=i 



m 

x JJ[ar,Ui,i 

»=i 



j • • • j ^i,ir(i) 



i=l 

we obtain 



i=i i=i 



1p k+1 O (^(x) = X Yl Y[[X, • • • , ?V(*)> • • • ' U J>(i) 

j=l i=l 

and this completes the proof of the proposition. 

2. Main result 



□ 



We recall that a normal automorphism (p of a group G is an automor- 
phism such that = for each normal subgroup H of G. These 
automorphisms form a subgroup of the group of all automorphisms of 
G. Obviously, this subgroup contains the subgroup of inner automor- 
phisms of G. It happens these subgroups coincide, for instance when 
G is a nonabelian free group [8], a nonabelian free soluble group [IT] , 
or a nonabelian free nilpotent group of class 2 [3]. On the other hand, 
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the subgroup of inner automorphisms is of infinite index in the group 
of normal automorphisms when G is a nonabelian free nilpotent group 
of class k > 3 [3]. Also note there are exactly two normal automor- 
phisms in a (nontrivial) free abelian group: x — > x and x — > x" 1 . The 
determination of all normal automorphisms in a free nilpotent group 
of class k > 3 seems to be an open problem. Note however that for 
k = 3, Theorem 2.1 below provides such a determination, since the free 
nilpotent metabelian group of class 3 (and of given rank) coincide with 
the corresponding free nilpotent group of class 3. One can find in [5] 
information about the structure of the group of normal automorphisms 
of a nilpotent group. 

Certainly, in a metabelian nilpotent group, each generalized inner 
automorphism is a normal automorphism, but a normal automorphism 
need not to be a generalized inner automorphism. However, our main 
result states that the converse holds in a nonabelian free metabelian 
nilpotent group. 

Theorem 2.1. In a nonabelian free metabelian nilpotent group, the 
group of normal automorphisms coincides with the group of generalized 
inner automorphisms. 

Before to tackle the proof of this theorem, we give a few conse- 
quences. Let ip be an automorphism of a group G. According to 
Schweigert [12], one says that (p is a polynomial automorphism of G if 
there exist integers ei, . . . , e m G Z and elements u%, . . . , u m G G such 
that 

<p(x) = {u^X^Ui) . . . (■u~V m u m ) 

for all x G G. For instance, in a metabelian nilpotent group, any gen- 
eralized inner automorphism is a polynomial automorphism. It turns 
out that in a nonabelian free metabelian nilpotent group, these notions 
coincide. 

Corollary 2.1. An automorphism if of a nonabelian free metabelian 
nilpotent group G is a generalized inner automorphism if and only if it 
is polynomial. 

Proof. Only the part 'if needs a proof. Therefore, suppose that (p : 
G — > G is a polynomial automorphism defined by 

<p(x) = {ui l x €1 u x ) . . . (u^x €m u m ) 
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and put e — ex + ■ ■ ■ + e m . If 72(G) = [G 1 , G] is the second term of the 
lower central series of G, it is not difficult to see that ip induces the 
automorphism Tp : x 1— ► x e [x,M] on the free nilpotent group G/ 72(G), 
where u = ul 1 . . . u^j2(G). An easy calculation shows that the relation 
Tp(xy) = Tp(x)Zp(y) is equivalent to the relation (xy) e = x e y e . This 
implies that e = 1, and so ip~ l is polynomial by [21 Theorem 1]. Now 
it is clear that tp is a normal automorphism, hence <p is a generalized 
inner automorphism by Theorem 2.1. □ 

In jl], it is proved that the group generated by all polynomial auto- 
morphisms of a metabelian group is itself metabelian. Therefore, we 
can state: 

Corollary 2.2. The group of normal automorphisms of a free metabelian 
nilpotent group is metabelian. 

Note that this result is valid even if the relatively free group is 
abelian, since the group of normal automorphisms is abelian in this 
case. 

Recall that an automorphism of a group G is said to be an IA-automorphism 
if it induces the identity automorphism on G/G'. We shall write 
IA(G) for the group of IA-automorphisms of G. In a nonabelian free 
metabelian nilpotent group G of class k, the group of normal automor- 
phisms is a subgroup of IA(G). Since IA(G) stabilizes the lower central 
series of G, it is nilpotent of class k — 1 (see for instance [T3], p. 9]), 
and thus so is the group of normal automorphisms. Also this result is 
a consequence of the fact that in a nilpotent group of class k > 2, the 
group generated by all polynomial automorphisms is nilpotent of class 



If d > 1 denotes the rank of the free metabelian nilpotent group G of 
class k, note that IA(G) is metabelian if d = 2 (by a result of C.K. 
Gupta [6]) or if k < 4 (in this case, IA(G) is nilpotent of class < 3). 
On the other hand, it is worth pointing out that contrary to the group 
of normal automorphisms, 1A(G) is not metabelian if d > 2 and k > 4. 
Indeed, without loss of generality, we can assume that G is the free 
metabelian nilpotent group of class 5 and of rank 3, freely generated 
by a, b, c. In this group, we define three IA-automorphisms /, g, h by 



k- 1 0. 



f(a) 
9(0) 



a[a,b], f(b) = b, f(c) = c, 
a, 9(b) = b[b,c], g(c) = c, 
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h(a) = a, h(b) = b, h(c) = c[c,a\. 

It follows 

\f,g](a) = a[c~ 1 ,b,a], [f,g](b)=b, [f,g](c)=c, 
[f,h](a) = a, [f,h](b)=b, \f,h](c)=c[a,b- 1 ,c], 

whence 

\f,h]o\f,g](c)=c[a,b-\c], 
[f,g] ° [f,h](c) = c^b' 1 ,^^^^,^. 
Consequently, [/, g] and [/, h] do not commute, hence IA(G) is not 
metabelian. 

3. Proof of Theorem 2.1. 

In all this section, we consider a fixed set S of cardinality > 2 and 
we denote by M k the free metabelian nilpotent group of class k freely 
generated by S. In other words, M k = F/F"^ k+1 (F), where F is the 
free group freely generated by S and 7^+1 (F) the (k + l)th term of 
the lower central series of F. The normal closure in a group G of an 
element a is written (a G ). 

Lemma 3.1. For any distinct elements a,b G S and any integer t, the 
subgroup ((a t b) Mk ) fl 7fc(Mfc) < M k is generated by the set of elements 
of the form 

[a*6, Ci, . . . , Cfc_i] , with Ci, . . . , c k -i G S (we suppose k > 1). 

Moreover, for any subset {a — ao, ai, . . . , a r — b} C S containing a and 
b, the subgroup 

((a*6) Mfc )n 7fc (M fc )n (a ,ai,...,a r ) 

is generated by the set of elements of the form [a*6, Ci, . . . , c^-i], wift 
Ci,...,c fc _i G {a ,ai,...,a r }. 

Proof. First suppose that £ = and consider an element u> G (6 Mfc ) fl 
7fc(Mfc). Hence w is a product of elements of the form [cq, c\, . . . , Cfc_i] ±1 , 
with q G 5. More precisely, we can write w = woWi, where wo 
(resp. Wi) is a product of elements of the form [co, ci, . . . , c k -i\ ±l 
with Q G S \ {b}, (resp. with q G 5, the element b occuring once 
at least in [co, ci, . . . , Cfc_i]). In fact, substituting 1 for the indeter- 
minate 6 in the relation w = WoWi and using the fact that w lies in 
(b Mk ), we obtain w = 1- Thus w is a product of elements of the 
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form [c , Ci, . . . , Cfc_i] ±1 , with q = b for some i G {0, . . . , k — 1}. If 
i — 1, we can write [co, Cfc_i] = [6, Co, . . • , Cfc_i] -1 . If i > 1, we 
have [c , ci, , c k -i] = [c , ci, b, . . . , c k -i]; by using the relation 

[c ,ci,b] = [ci,b, c ] _1 [6, c ,ci] _1 , it follows 

[c ,ci, . . . ,6, . . . ,c fc _i] = [6,ci,c , . . . ,c fc _i][6, c ,ci, . . . ,c fc _i] _1 . 

Thus we have shown that any element of (b Mk ) D r y k (M k ) is a prod- 
uct of elements of the form [6, Ci, . . . , Cfc_i] ±1 , with q G 5. Since 
[6, Ci, . . . , c fc _i] G (6 Mfc ) fl 7fc(M fc ), the first part of our lemma is proved 
when t = 0. 

Now consider the general case. Actually, since clearly S' = {a l b} U 
5 \ {b} is a free basis of M k , we can use the result obtained in the 
particular case. It follows that ((a*6) Mfe ) n -f k (M k ) < M k is generated 
by the set of elements of the form [a*6, c±, . . . , c k -i], with c, G S". But 
in fact we may take q G S and so conclude, since 

[a% ci, . . . , a*6, . . . , c fc _i] = [a% c ± , . . . , a, . . . , c fc _i] * [a*6, Ci, . . . , b, . . . , c k 

Finally, consider an element w G ((a t b) Mk ) fl , ~f k (M k ) fl (a , ai, . . . , a r ). 
we can express w in the form w = w'w", where w' (resp. w") is a 
product of elements of the form [a*6, Ci, . . . , Cfe_i] ±1 with ci, . . . , c k _i G 
{a , ai, . . . , a r } (resp. with ci, . . . , Cfc_i G 5, an element of 5 , \{a , ai, . . . , a 
occuring once at least in the sequence ci, . . . , Cfc_i). Substituting 1 for 
all indeterminates in S \ {a , a l5 . . . , a r }, the equality iu = w'w" gives 
u> = w'. This completes the proof of the lemma. □ 

As usual, the expression [x, n y] is defined in a group by [x,oy] = x 
and [x, n y] = [[x, n _i y], y] for each positive integer n. 

For a fixed subset {ao, . . . , a r } C 5 and a function A : {0, . . . , r} — > 
N, we define in M k the symbol [x, y, A] (x, y G M fc ) by 

[X, y, A] = [x, y, A (0) Q0,A(1) Ol, • • ■ ,A(r) a r] • 

Note that for any sequence bi, . . . , b k of elements of {a , . . . , a r }, there 
is a function A : {0, . . . , r} — > N such that [x, y, 6i, . . . , 6^] = [x, y, A], 

with A(0) H h A(r) = fc (it suffices to apply the relation [u,v,w] = 

[u,w,v], valid in any metabelian group whenever u belongs to the de- 
rived subgroup). If j,j' are distinct given integers in {0, . . . ,r} and if 
A(j) 7^ 0, we define the function : {0, . . . , r} -> N by 

A^(j) = A(j)-1, A^(j") = A(j") + 1 and 
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Ag } (i) = A(i) foraUie{0,...,r}\O,/}- 
When A is not the null-function, we shall denote by m(A) the least 
integer j such that A(j) ^ 0. 

If S is ordered, we may define in basic commutators (see for 
example [9, Chapter 3]. Recall that a basic commutator of weight k! 
(2 < k' < k) is a commutator of the form [b\, 62, • • • , bk>] (h G S), with 
b\ > 62 and b2 < b% < ■ ■ ■ < bk> . Any set of these commutators freely 
generates a free abelian subgroup of M' k . 

In the next lemma, we aim to express a product of commutateurs of 
the form [a s , a«, A] as a product where only basic commutators occur. 

Lemma 3.2. Let {ao, . . . , a r } be a finite subset of S (r > 0). Choose 
an integer s G {0, . . . ,r} and consider an element w G Mk+2 (k > 0) 
of the form 

w = H[a s ,a u A}^ (e(z,A)GZ), 

i,A 

where the product is taken over all integers i G {0, . . . , r} and all func- 
tions A : {0, . . . , r} -> N snc/i that A(0) H h A(r) = fc. T/ien: 

(i) We have 

w= J] K,a,,A]^ A ) J] [a,,a s ,A]-^ A ) 

i<s,i<m(A) s<i,i<m(A) 

J] [a t ,a s ,A]-^ J] [a i ,a fIl(A) ,A« A)) ]-^) 

s<m(A), m(A)<i m(A)<s, m(A)<i 

x n k>^ ( A),A» (A)) ]^ A ) 

m(A)<s, m(A)<i 

(%i a// t/iese products, i lies in {0, . . . , r} \ {s} ^. 

(ii) VFe /iaf e to = 1 only if all exponents e(i, A) with i G {0, . . . , r}\ {s} 
occuring in the expression of w are zero. 

Proof, (i) First we write w as a product of two factors: 

w= J] [a s ,a,,A]^ A ) J] [a s ,a,,A]^ A ). 

i<m(A) m(A)<i 

The first factor can be expressed in the form 
J] K,a,,A]^ A ) = J] K,a,,A]^ A ) J] [a s ,a,,A]^ A ) 

i<m(A) i<s,i<m(A) s<i,i<m(A) 

J] K,a,,A]^ A ) H [a t ,a s ,A}-^ A \ 

i<s,i<m(A) s<i,i<m(A) 
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Now we deal with the second facteur. We have 
J] [a s , ai ,AY^ = J] [a s ,a,,A]^ A ) J] [a s , a h A}<^ 

m(A)<i s<m(A),m(A)<i m(A)<s,m(A)<i 

s<m(A), m(A)<i m(A)<s, m(A)<i 

Therefore Lemma 3.2(i) is proved if we show the relation 

(1) II K,a l? A]^ A ) = 

rn(A)<s,m(A)<i 

J] [a t , a m(A) , AW (A)) ]- e(i ' A) x ]J [a., a m(A) , A« (A)) ] e(i ' A) . 

m(A)<s,m(A)<j m(A)<s, m(A)<j 

For that, write more explicitly the commutator [a s ,Oj, A] (in the fol- 
lowing equalities, we write m instead of m(A)): 

[a s ,ai,A] = [a s , aj,A(o) GO) • • • )A(r) o r ] 

= [a s , Cli,A(m) "irn • • • ;A(r) a r] 

[<2 S , Oj, 8m)A(m)-l Omj • • • ;A(r) ^r] • 

Since [a s , cii, a m ] = [aj,a m ,a s ] [a m ,a s ,aj] = [a,i, a m , a s ] [a s , a m , ai\, 
we obtain 

(2) [a„Oi,A] = [ai,a m , A^] -1 ^, a m , A^]. 

Relation (1) is now an immediate consequence of (2). 
(ii) Choose an order in S such that a < a x < ■ ■ • < a r . Under this 
condition, all commutators occuring in the expression of w obtained in 
the first part of the lemma are basic commutators. Suppose that w — 1. 
Since basic commutators of the form [aj, a iy . . .} G {0, . . . , r} \ {s}) 
occur only in the fourth factor, we have e(i, A) = whenever m(A) < s 
and m(A) < i. It follows 

w= J] [a s ,a,,A]^ A ) J] [ ai ,a s ,A]-^ A ) 

i<s,i<m(A) s<i,i<m(A) 

x J] [ ai ,a s ,A]-^ A ) = l. 

s<rn(A),m(A)<i 

But all basic commutators occuring in this equality are distinct. Thus 
e(i, A) = for all integers i ^ s and all functions A, as required. □ 
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Lemma 3.3. Let ip be a normal automorphism of M k +2 (k > 0) acting 
trivially on 1/^+2/7^+2(^+2) ■ Then, for all distinct elements a,b e S, 
there exists a generalized inner automorphism ip of M k +2 such that 
ip(a) = ip(a) and ip(b) = ip{b). 

Proof. Let a, b be two distinct elements of S. Then a~ V( a ) an d b~ l (p(b) 
belong to (a Mfc + 2 ) n7 fc + 2 (M fc + 2 ) and (b M "+ 2 ) f] lk+2 (M k+2 ) respectively. 
By Lemma 3.1, there is a finite subset {a — a , a±, . . . , a r — b} C S 
such that 

<p(a) = <p(a ) = a J][a , a t , A] a ^ (a(i, A) e Z), 

i,A 

ip{b) = ip{a r ) = a r l[[a r , a t , Ap' A ) ((3(i, A) e Z), 

i,A 

where the two products are taken over all integers % G {0, . . . , r} and all 

functions A : {0, . . . , r} — * N with A(0) H V A(r) = (as in Lemma 

3.2, [a s , a,, A] is defined by [a s , a,, A] = [a s , a,,A(o) «o, • • • ,A(r) a r ]). Note 
that if 15*1 =2 (and so r = 1), Lemma 3.3 is easily verified by taking 
the generalized inner automorphism ip defined by 

i,{x) = x l[[x, a u A] a ^ A ) Y[[x, oo, Af °< A ). 

A A 

Thus we can assume in the following that > 2. For any positive inte- 
ger t, (aQa r ) _ V( a o a r) = (aQa r ) _1 (/9( a o)V( a r) belongs to (a , ai, . . . , a r ). 
Therefore, once again by Lemma 2.1, (p(a,Qa r ) can be expressed in the 
form 

ip(aia r ) = a*a r l[[ala r , a,, A]^> A ) {r] t (i, A) e Z). 

Since [a , a i? A] is a commutator of weight k + 2 in a nilpotent group 
of class /c + 2, we obtain 

i, A i,A 

Thus the relation ip{a^a r ) = y?(ao)V( a r) implies that 

(3) °- a ]^ (i,a) °- A ]" t(i ' A) 

i, A i, A 

= H[a ,a t ,Ar^H[a r ,a t ,Af^. 

i, A i,A 
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Choose an order in S such that a < a\ < ■ ■ ■ < a r . Then we can use 
Lemma 3.2(i) (with s = or s = r) to express each product in (3) as 
a product of basic commutators (or their inverses). The first product 
gives 

i,A 0<i,i<m(A) 0<m(A),m(A)<j 

and so Y[[a , a h A]*"*^ = J| [a,, a , A]~*' ? * (i ' A) , where this prod- 

i,A iy^O, A 

uct is taken over all integers % G {l,...,r} and all functions A : 

{0, . . . ,r} — > N with A(0) + • • • + A(r) = k. 

Likewise we have JJ[a , a u A] to(i - A) = j J [a i} a , A]~ to(i ' A) . 

In the same way, applying Lemma 3.2(i) with s = r, the second product 
of (3) gives 

nk-,a*,A]^' A )= J] [a r ,a,,A]^ A ) 

i,A iytr,i<m(A) 

x n [fli,^,^]^) n K-M^Aji/^. 

j^r, m(A)<j i^r, m(A)<i 

Finally, the last product of (3) gives 

Y[[a r ,a t ,Af^ = J] [a r ,a,,A]^ A ) 

i,A iytr,i<m(A) 

x 17 \a- a , A1 A (r) r^' A ) TT [« o , A1 A (i) 1^' A ) 

i^r, m(A)<i i^r, m(A)<j 

Thus relation (3) can be written in the form 

(4) Hia^ao^}-^^ J] [a r , ai ,Ar^ 

i^0,A i^r, i<m(A) 

X J] [«^ m (A),A|2 (A)) ]-- (i ' A) II [«r.MA),A« (A)) ]*^) 
i^r, m( A) < i i 7 ^r,m(A)<i 

= n K*o^]- ta{iA) n k^- A i^ ,A) 

i^O, A iytr,i<m(A) 

x n ^.maj.aw^]-^) n k^-(A),A« (A)) ]^ A) 

iy^r, m( A) <i Jn( A) <i 

(so each commutator occuring in this relation is a basic commutator). 
Now consider an integer i e {1, . . . , r— 1} and a function A : {0, . . . , r} — > 
N, with A(0) + • • • + A(r) = k (we can always suppose that r > 1 
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since \S\ > 2). By identifying the exponents of the basic commutator 
[dj, a , A] of each side of relation (4), it is easy to see that 

(5) t Vt (i, A) + Vt (i, A$) = ta(i, A) + (3 (i, A^J) 

if A(r) > 0, and r) t (i, A) = a(i, A) if A(r) = 0. We prove by induction 
on A(r) that actually, we have always the equality rj t (i : A) = A). 
At first observe that if A(r) > 0, we have A^j(r) = A(r) — 1 and so 

r]t (i, A^j = a (*'^(r)) ^y induction. Hence relation (5) implies that 

a (i, A$) - (i, A$) = t {«(<, A) - ^(i, A)} . 

Consequently, each positive integer t divides the integer a (i, A^j^ — 

/3 ^i, A|°^, which is independant of t. It follows that a (i, A^jj = 

/?(i,A$) and so r)t(i, A) = A), as required. 

Using theses relations and taking t — 1, relation (3) implies 

JlK, A]^> A ) l[[a r , a,, A]^' A ) = l[[a , a r , A]^> A ) JJ^, a,, Ap' A ) 

A i,A A i,A 

(we write 7/ for t^) and so 

JJK, Oi, A]^' A ) = «i, A]^' A ) GO, A]^A)-,(r,A). 

i,A i,A A 



Since <^(a r ) = a r JJja r , Oi, A]^ l ' A \ we obtain 

(6) y?(a r ) = a r JjK, a,, A]^> A ) J]K, ao, A] ^-"^ 

i,A A 

Now consider the generalized inner automorphism ip defined by 
${x) = x H [ X , a h A]^- A ) ]J[x, ao, A] a ^ A ^° A ^ rA \ 

i=l,...,r,A A 

We have 

ip(a ) = a J | [oq, a u A} a{iA) = ip(a ). 
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In the same way, 

i=l,...,r— 1, A A 

= a r JI [a r , a,, A]^- A ) J][a r , a , A]^> A ) + "(°' A )-^' A ) 

i=l,...,r— 1, A A 

= a r l[[a r , a t , A}^ JJk, «o, A]^> A )~^ A ) 

i, A A 

and so ■0(°r-) — V?( a r) by (6). This completes the proof of Lemma 
3.3. □ 

Lemma 3.3 is actually a weak form of the next result. 

Lemma 3.4. Let ip be a normal automorphism of (k > 0) acting 
trivially on M^+2 / l lk+2{Mk+2) ■ Then <p is a generalized inner automor- 
phism of M k+2 . 

Proof. We can assume that jjS'l > 2 (otherwise Lemma 3.4 is a con- 
sequence of Lemma 3.3). Consider two distinct elements a, b G S. 
According to Lemma 3.3, there exists a generalized inner automor- 
phism ip such that <p(a) = ijj(a) and ip(b) = ip{b). It suffices to prove 
that for any c G S \ {a, b}, we have <p(c) = ip(c). For that, apply 
again Lemma 3.3: there are generalized inner automorphisms ifj',ifj" 
such that ip(a) = ip'{a), ip(c) = ip'(c) and (p(b) = ip"(b), tp(c) = ip"{c). 
There exists a finite subset {a , . . . ,a r } C S, containing a,b,c, such 
that ip,ip',ip" can be defined by the equations 





= X I 

i,l 


[[x, 

\ 


a,,A]^ A ) 




= xl 

1,1 


[[*, 
\ 




ip"(x) 


= xl 


[[*, 








\ 





(the products are taken over all integers % G {0, . . . , r} and all functions 
A : {0, . . . , r} -> N with A(0) + • • • + A(r) = k). Since ip{a) = ip'{a), 
we have 

a JjK a t , Ap> A ) = a J][a, a t , Af'^ 

i,A i,A 
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and so 

n[a,Oi,A]^)-^ = l. 

i, A 

Applying Lemma 3.2(H), we obtain e(z, A) = e'(i, A) for all functions 
A and all integers i G {0, . . . ,r} such that 7^ a. Similarly, we have 
e(i, A) = e"(i, A) if a { ^ b and e'{i, A) = e"(z, A) if a { ^ c. It follows 
that e{i, A) = e'(i, A) for all function A and all integer i G {0, . . . , r}, 
hence ^ = tp'- Thus <^(c) = ip'{c) = ip(c), as required. □ 

Proof of Theorem 2.1. We argue by induction on the nilpotency class k 
of Mfc. If k = 2, the result follows from (3J Theorem 2(h)] (in this case, 
each normal automorphism is inner) . Now consider a normal automor- 
phism if of Mfc, with k > 2. Then induces a normal automorphism 
on the quotient group Mk/^kiMk). By induction, since this quotient 
is isomorphic to Mk-i, there exists a generalized inner automorphism 
ip : Mk — > Mfc such that y?(x) = ip(x)6(x), where 9{x) is an element of 
7fc(Mjfc). It follows that ^"^^(x)) = x^" x (^(x)). Thus V' := V 
is a normal automorphism of acting trivially on M^j^i^iMk). By 
Lemma 3.4, ip' is a generalized inner automorphism, and so is <p = ijjoijj'. 
This completes the proof of Theorem 2.1. □ 

We end with a question: assume (p is a normal automorphism of a 
free nilpotent group G of class k > 4 (and of rank > 1). Is if of the 
form 

if : x — > x [x, Ui] X ^ . . . [x, M m ] A ^ m ' ) (ui G G, X(i) G Z) ? 
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